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Abstract 

Let X be a metric space and let [i be a probability measure on it. 
Consider a Lipschitz map T : X — > R n , with Lipschitz constant < 1. 
Then one can ask whether the image TX can have large projections 
on many directions. For a large class of spaces X, we show that there 
are directions (f> G S 71 ^ 1 on which the projection of the image TX is 
small on the average, with bounds depending on the dimension n and 
the eigenvalues of the Laplacian on X. 



1 Introduction 

Let (X, m) be a metric space and let /i be a probability measure on X. 
Consider a Lipschitz map T : X — > IR n , with ||T||^ p < 1, where M. n is taken 
with the standard inner product < -, • > and the corresponding Euclidean 
norm | • |. 

Define another (semi) norm on IR n by setting for each 9 G M. n , 

\\e\\ L2 ■= (^J < Tx,9 > 2 dn(x] 

This norm is known as the covariance structure of the push-forward mea- 
sure T/x, and we shall regard it as measuring the size of the projection of the 
image of X onto the direction 8. It is then natural to ask, for a given space 
X, whether an image of X can have big projections on many directions. For 
example, take X to be the unit interval [0, 1], with Lebesgue measure, and 
let T : [0, 1] — > M™ be a Lipschitz map (here and in what follows, Lipschitz 
will mean "having Lipschitz constant < 1"). By considering a few pictures, 
it is clear that if n is large then there should be a direction with a small 
projection and we are interested in quantifying this phenomenon. It turns 
out that this particular situation was investigated already by Gohberg and 
Krein, in a different formulation and context (related to spectral properties 
of smooth kernels), see the book [GKJ, Chapter III. 10.3 . 
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Theorem 1.1 ( |GKj ). There is an absolute constant c > 0, such that for 
every n > 1 and every T : [0, 1] — > MJ 1 with \\T\\L ip < 1, there is 6 £ S n ^ 1 
such that ||T||x 2 < c ■ n~2 . 

Our objective is to provide a similar result for general metric spaces with 
measure on which an appropriate notion of a derivative can be defined. How- 
ever, for the simplicity of presentation, we shall restrict our discussion to 
finite spaces X which are graphs with the shortest path metric. The state- 
ment and the proof of the following result can, for instance, can be repeated 
with straightforward modifications in the setting of Riemannian manifolds. 

Let X be a finite set and let E C X x X be a set of edges such that 
(X, E) is a connected undirected graph without loops. For x,y £ X, write 
x ~ y iff (x, y) £ E and let d(x) denote the degree of x. We endow X with 
the shortest path metric and we set /i to be the stationary distribution of a 
simple nearest neighbour random walk on (X,E), fx(x) = |f|j. Denote by 
L(X) the space of real-valued functions on X. The Laplacian on L(X) is 
defined by 

A </)w= 2 (/w-d4)E/w 

As is well known, this is a self-adjoint non-negative operator, with a one 
dimensional kernel consisting of constant functions. We denote by {Aj}^ = [ 
the sequence of non-zero eigenvalues of A in non- decreasing order, including 
multiplicities. 

Theorem 1.2. There is an absolute constant c > such that for every graph 
X as above, every n > 1 and every Lipschitz map T : X — > R n , there is a 

1 — i 

direction 6 £ S 1 ™" 1 such that \\0\\l 2 < c • n ~ 5 \ n /2j-r 

Example 1.3 (Discrete Space) . Let (X, m) be a metric space such that m(x, y) - 
1 for all x 7^ y, and let fi be the uniform probability on X. Then for every 
Lipschitz T : X -»■ R n there is £ IR n such that 

|0|U 2 < 4r (!) 



Note that, interestingly enough, the size of the space, \X\, does not appear in 
this bound (except that, of course, for n > \X\ we always have 9 £ M n with 
||#||l 2 = 0). That is, one can not increase the minimal projection size of X in, 
say, M 20 , by adding more points. To prove (JTJ), note that (X,m) corresponds 
to a clique graph, and the Laplacian has a single non-zero eigenvalue, which 
is of the order of a constant and has multiplicity \X\ — 1. 



2 



Example 1.4 (Combinatorial Cube). Here X is the set C d = {0, l} d , with the 
Hamming metric 



m{x, y) = \{i E {1, d} \ y<}| 

where x = X\...x^y = yi-.-Ud G C d and /i is again taken to be the uniform 
probability measure. The non-zero eigenvalues of the Laplacian on X are 

-j with multiplicity ( ™ ^ , k = l,...,d (See, ex. [Diacj ). The n-th small- 
est eigenvalue is therefore of the order log j n - > and we obtain that for every 
Lipschitz T : X -> R n , there is 9 e S 71 ' 1 such that 

\\ e \\L 2 < C 



yjn ■ Vlog(n) 

Our approach to Theorem 11.21 extends the argument in [GK] and, nat- 
urally, Theorem 11.11 can also be seen as a consequence of the principle of 
Theorem 11.21 Indeed, the eigenvalues of the Laplacian on [0, 1] satisfy, up 
to multiplicative constants, that A„ ~ n 2 (as can be seen by double differ- 
entiating sines and cosines). Hence the decay rate of n~z ■ (n 2 )~2 = n~z in 
Theorem 11.11 



2 Proof 

Fix a graph (X, E) with the stationary measure fi on it. Let T : X — > W 1 be 
a Lipschitz map. It will be convenient to introduce an additional assumption, 
that 

jT(x)dfi = Q. (2) 

With conditions of Theorem 1 1 . 2 1 and this assumption, we will show that there 
is 6 e S n ~ x such that 

||0|| L2 = c . n -|A~ 5 /2j . (3) 

This implies the result for arbitrary Lipschitz T : X — > IR n . Indeed, assume 
that v := j Txdfj, ^ 0. Denote by P the orthogonal projection onto the 
n — 1 dimensional space orthogonal to v. Then the composition P o T is a 
Lipschitz map into that space and |(Po T)(x)dfi = 0, so ([3]) can be applied 
in dimension n — 1. 

The notion of a gradient on a graph is folklore, although not particularly 
frequent in the literature. We thus recall the definition. 
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Define an inner product on L(X) by 



[f,g]x = J f(x)g(x)d(i(x). 

Denote by L(E) the set of real valued functions on the set of edges, E, and 
let v be the uniform probability measure on E. We equip L(E) with the 
inner product 

[f,9]E = J f(e)g(e)du. 

Fix an arbitrary orientation on E, i.e. for each edge e = {x, y} choose in an 
arbitrary way an enumeration v\, v\ of the vertices of the edge. The gradient 
operator on X is defined by y : L(X) — > L(E), 

(Vf)(e) = f(vl)-f(v 2 e ). 

One can verify by direct computation that the usual relation A = y* o y 
holds, where y* is the Hilbert space adjoint of y. Note that the Laplacian 
does not depend on the orientation on E. 

Denote by L (X) the subspace of L(X) that is orthogonal to the constant 
functions. Since KerA is the space of the constant functions, the Laplacian 
is invertible on Lq(X) and hence the gradient is also an invertible operator 
from Lq(X) onto its image. The inverse of the gradient will be of importance 
in what follows and we denote it by T : 7m(y) — > L (X). 

We also recall the notion of singular values of an operator. If V and W are 
(say, finite dimensional ) Hilbert spaces, and A : V — > W is a linear operator, 
then A* A is a non-negative self-adjoint operator. Let {\i(A* A)}f™{ v be 
the eigenvalues of A* A, in non- increasing order, with multiplicities. Then 
singular values of the operator A are the non- increasing sequence Sj(A) = 
VW^A). 

The singular values of A have a simple geometric interpretation. If B2CV) 
denotes the unit ball of V, then the image A(B2(V)) is an ellipsoid in W and 
Si(A) are precisely the lengths of the principal axes of this ellipsoid. 

The singular values satisfy Si(A) = Si(A*) and singular values of a com- 
position can be bounded by the following inequality due to Ky Fan. Let 
A : U — >■ W and B : W — > V be two operators on Hilbert spaces. Then, for 
every i,j > 1, 

Si+j-^BA) < Si(A) Sj (B) (4) 
Finally, the Hilbert- Schmidt norm of an operator is defined by 

\\A\\ HS = V^A= (J2 S '( A ) 
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Note that since is a non-increasing sequence, 

Si (A) < (5) 

for all i. 

More details on singular values can be found, for instance, in (Bhaj or 

Proof of Theorem M.B. As mentioned above, we assume that condition 
holds. Let Dt denote the gradient of the map T, i.e. 

D T {e)=T{vl)~T{vl). 

Since T is Lipschitz, Dt is bounded, i.e. |Z>r(e)| < 1 for all e G E. 

For every 9 G M n consider the function on X, f$(x) =< 9,Tx >. By (j2J), 
/e G Lq(-E) and clearly (v/e)( e ) =< 6,D T (e) > and 

/* = r(< #,d t >). 

Let 

fi L2 (X) = {/:X^M | [/,/]* <l} 
denote the unit ball in L(X) and write ||#||l 2 i n a dual form: 



L2 = sup geB2 ( X ) J g{x) <9,Tx> d\i. 



Then 



J g{x) <9,Tx>dfi= [g, f e ] x = [g, T o V Mx = [r*#, \/f e } E 
Next, write 

F*9, VfeU = J (r*^)(e). < 0,£> T (e) > tZi/(e) =< 0, ^ (r^)(e) ■ D T {e)dv{e) > 
Denote by D : L(E) — >■ M n the operator that acts by 

-Dm = y it(e) • DT{e)dv 

With this notation, 

||6>|| L2 = sup geB2 <9,Do T*g >= sup < 9, <\> > (6) 



where £ = D o T*B 2 is the dual (in R n ) ellipsoid of the || • \\l 2 norm. 
Our aim is to bound the quantity 

inf ||0||l 2 . 

By (J6]), this quantity equals the length of the smallest principal axe of the 
ellipsoid £. Since the lengths of the principal axes are the singular values of 
D o T*, we bound the singular values of this operator. 

The singular values of T* are given, Sj(T*) = Aj 2 , where Aj are the non- 
zero eigenvalues of the Laplacian (in non-decreasing order, so that Sj(r*) do 
not increase). To bound the singular values of D, we show that 

\\D\\ HS <1. (7) 

Indeed, one readily verifies that 

Dob*(d) = J < 6, D T (e) > D T {e)dv. 

For fixed e G E, the trace of an operator 9 \— >< 6,Dt(g) > -Dt(c) is 
|-Dr(e)| 2 < 1, implying ([7]). Now, by ([5]), Si(D) < and an application 
of (H]) (with i = j = n/2) completes the proof. □ 
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